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ABSTRACT 

An evaluation was done of New York City Public 
Schools* Bilingual Education Through the Arts program (Project B^A) , 
which served poor, language minority elementary school students. The 
project enrolled 366 Spanish speaking kindergarten through siscth 
grade students at 2 elementary schools. Ninety-seven percent of the 
students w-'re eligible for the Free Lunch Program. Project BETA 
targeted schools with a recent influx of immigrants and served 
Spanish-speaking students with limited English proficiency. The 
Project adapted the Learning to Read Through the Arts program for 
students' linguistic developwent. Students received a weekly 1.5-hour 
period of English as a Second Language (ESL) and Speuiish reading as 
well as irorkshops in musical arts or visual arts. Students also 
attended a variety of art events and museums throughout the city. 
Evaluation of the program was based on demographic dat^ citywide 
student test scores, and interviews with and surveys of the program 
directors. Results indicate that program strengths lay in its 
positive impact on students across the curriculum, with students 
sh-^wing increased enthusiasm and motivation. Project BETA was fully 
implemented and met its objectives for ^L, arts appreciation, staff 
development (two out of three objectives), curriculum development, 
and parental involvement. Two appendices summarize the data 
collection and cmalysis procedures and list instructional materials. 
(JB) 
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FOREWORD 



The body of this lepc^ is preceded by ao Extract wlik:fa preseats an omview of sa&nt points of 
the preset: fimdmg eiuoIIiMat fi^um; badqpoin^ (tf stuctents 

programmii^ features, suengths, and lnnitaik>ns, bdsifii^ die onioome of aD objectives. Tbe extract also 
presents tbe coachisioas drawn by tke Office of Researdi, Evaluation, and Ass^sment (OREA) about tbe 
program and its reooom^dations for program iaquo^^raKnt 

Hie extract is fc^owed by tbe body of the report, tftled Program Assessment . Ihh bdudes such 
information as ttafiiag, ]m)gram lo^teBEientatkHi, and outc(»ne and ioq^lteamitation cb^caWts. 
Instmctjonal ob^ctives are pre^oted first, foBowed by noninstructioaal objectives. Tbe repwi then 
afkkesses tbo» »qwcts of programmii^ mandated by Htte vn regntetioas that do moi ba^ spctH^aSfy 
stated ofa^ctiv^ Hus may be information on attradame and dsopofA rate, grade retentioii, 
mainstreamai^ r^errals out of tbe program to meet spedal nee<b oS tbe students, and witlKbawate. A 
ca» histoiy amcbutes tbe report. 

Data for this profile were collected and anafyzed u«ng a variety of procedures, wfaid are 
described in tbe A ppendix following the text. 
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EXTRACT 



PRQJFCT COORDINATOR! Yvetle Parsi Boronow 

Sims 

School Grade Lev^b f-prplfa^pt (Tolal366) 



FUNDING CYCLE; Year 4 of 5 



P S. 5X 
P.S. 27X 



K.6 
K-6 



164 

202 



STUDENT BACKGROUND 

Native Language Numher of Students 



Spanish 
Unreported 



362 
4 



Countries of Origin Number of Students 



Unites States 

Puerto Rico 

D<Hiiinkan Republic 

Mexico 

Honduras 

Ecuador 

Other countries 



Mean Years of Education in Native Country : U; in the United States: 3.8 
Percentage of Students Elkibte for Free Lunch Program: 97.0 



147 
136 
33 
10 
10 
9 
21 



ADMISSION CRfTERIA 

The project admitted students who scored at or below the 40th percentile on the Language Assessment 
Battery (LAB) as well as a number of English proficient students who would benefit from the program and whose 
parents requested placement. 



PROGRAMMING 
Features 

Project BETA targeted two elementaiy schools in Commn^ty Sdiool Dtorict (C.S.D.) 7 with a recent 
influx of immigrants. Spanidi-speaking students of limited Ei^&h proficiency (LEP) and a number of English 
profjcienl (EP) students received supplementaiy insin»:tk>n through eiqx^re to the arts. 

Project BETA adapted the Learning to Read Through the Arts (L.R.T.A.) program for students' 
linguistic dcvetopment. BETA students received a weekly one-and-a-half-hour period of E.S.L. and Spanish 
reading, as weU as workdiops in musical arts at P.S. 5 or visual arts at P.S. 27. Students also attended a variety of 
ari e\'ents and museums throughout the cit)'. 



Streneihs and Limiiatioiis 



Program sireogUi lay b hs po^tive 'mpaxA on }Miitk^tii^ studenu: project staff reported thai as a 
result of jft^ti^ the program, stu<tents were taxxe creath^ micns the amiaihim, had <tevek^»^ a waix of pride 
in and respect for cnltm^ aru asd iastitatkms, and were sotaUy more rathusia^ in readh^ wrdbg, and 
subject area lessons. Project BETA staff reported that students were motivated to create their own stones and 
aa)iured vocabidaiy quicfcly becau^ their eathnaaan for discuss^ the arts. 

Buil^etary constraints limited the nimiber books that the project oonld purdiase as well as the number 
of visits to cnhttral institatxms that it oottM mbodize. 

CONCLUSIONS AND RECOMMENDATIONS 

Frojea BETA was fafy hnplemented. It met its ot:jectim for ES,L., arts anjrec&tion, staff 
developmrat (two out of three olgectives}, curriculum development, and parental invoNement. The project fa0ed 
to meet its (^ecti«« for N.L^ 

The oottchisk>ns, ^nsed on the findings of this evahiatk», lead to the foOowii^ r«x»nmendatk>ns: 

• Explore ways in which to meet the N.L^ objective. 

• Encourage project staff to enroll in university cour^. 
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PROGRAM ASSESSMENT 

STAFFING 

Proied Staff fy^ded bv Title Vll Staff (Total 2) 

Title De^tree Uaguaye Conmctencies BH? fVPf^ng 

Project Coordinator Master's, ^ni^ Part tune 

Prof^i^nia! Dq>k)nia 

Paraprofes^nal Collide cretfits l^>aiibh Fulltime 



Other Staff Worl dny With Project Stadcnts (Total 16) 

D^ree Certificatfoii tiflBga^ q^i^ipf ^fp^^s 

Bachelor's 13 BiL Cohuiktb Brandies 12 Spanidi 16 
Master's 3 BOin^l T.PJD. 4 



IMPLEMENTATION AND OUTCOMES (Objectives prefaced by •) 
language InstnictioD 

Project BETA adapted the Learning to Read Ihrou^ the Arts (L.T.R.A.) program. Staff trained 
participating teachers to use a thematic and whole language approach for students' Spanish and English language 
instruction. Teadiers de\«loped lessons for regular E.S.LJSpanish reacSng instruction around the themes initiated 
in arts-oriented workshq>s and on visits to cuhural events. Teachers worked with each student in charting 
individual language acqui»tk>n fay provitting ook>rfuL personal osvekp^tA^Js wfaidi contained i^>cabnlaiy ymnSs 
and kiK>wle(l^e assessment sheets. Students benefited from ooq^ative tearaing strat^i» dustering in small 
groups to prepare Unguistically-based arts projects such as plays. Classroom teachers then used these projects to 
stimulate further classroom diKUSskm. 



English as a Second Language (E.S.L.) 

• By June 1991, as a result of participating in the prc^ram, students will demonstrate achievement 
beyond expectation in Ei^lish as a Second Language (p<.05) in N.CE-s as measured by the English 
version of the Lai^ttage As^n^t Battery (LAB). 

Evaluation Instrument: Language Ass^sment Battciy* 

Pretest: March 1990; posttest: March 1991. 

Number of students for whom pre- and posttest data were reported: 298 
Mean gain: 5.2 N.C.E.S (s.d.« 22.6) 



*OR£A i»ed a gap reduction design to evaluate the effect of suppkmentaiy instruction on project students' 
performance on the LAB. Since all LEP stuctents in New York Qly are entitled to such instruction, no valid 
comparison group exists among these students, and OREA used instead the group on wh^ the LAB was 
normed. Test scores are reported m Normal Curve Equivalents (N.CE^), which are normalized standard scores 
wth a mean of 50 and a standard deviation of 21.06. It is assumed that the norm group has a zero gain in 
N.C.E.S in the absence of supplementary instruction and that partidpating students' gains are attributable to 
project services. 



Mean gain is statisticaDy s^iftcant (!« 3.95, s<.05). 



Preject met Directive. 



Native Lanfuaye Arts W.L.A.^ 

Students IvAaag titerecy skills in native langua^: estimated at <»e percent. 

• By June 1991, as a resuh of partit^tiog in the program, students wiQ demon^te achievement 
b^nd eq^ctation (p<.05) in N.C.E.S on the ^ansh vernon the Language Aswsstnent Battery 
(LAB). 

Evaiuatfon Instrument: Language Assesancnt Battery, Spanish version 
Pretest: May 1990; posttest: May 1991. 

Number of stwtents for v^jom pre- and posttest data were rq>orted: 175 
Mean gain: -3.7 N.C.E.S (s.d.« 16.1) 
Project did not meet oltiectiw. 

Arts AporeciatioD (Visual and Musical) 

Arts cluster teachers provided \k"orkshops specifically uQored to devctop studeots* skills, after which 
students prodtKred their own art works. Art teachers assened each i^udent's development based on the work 
produced or skilk M:hieved. Students ak» coc^rativefy created a variety of projects and/or performed together. 

Student's art works were di^layed in classrooms, at k)cal businesses, and at the Bronx Museum of the 
Arts. Students performed flamenco, African, and other dances at events ^nsored by Project BETA and the 
Bronx Museum of the Arts. 

• By June 1991, 80 percent of the parlicipaiiiig students will demonstrate knowledge and apprcciaiion 
of varbus art forms. 

Evaluatk)n Instrument: Surveys used to assess knowlet^e and appredatk>D of the arts. 
Number of stuitents for art performant^ data were reported: 3S8 
Percentage of ^udents that denK>nstrated knowledge and aj^reciation of an: 99.7 
Project net objective. 



Staff Development 

• Partkipatii^ teachers will demonstrate a greater aWUty to use various art forms in their E.S.L. and 
Spanish reading instriKrtion as measured by les«>n plans and clasroom (temonstrations. 

As a result of ooordinaiii^ lessons with arts^uster teadiers, attending arts events, and receivjng on-going 
staff training, particq)ating teachers wre better able to use art fbniB in their E.S.L. and Spanidi reading 
instruction. Project staff identified these improved skills in intermittent classroom observations, reviews of lesson 
plans, and ongoing teacher evaluatk)o. 

Project net ol^jectivr. 
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• Ai] program staff wfl] pankipaie in teacher trainic^ ooafereni^ and workups. 



All Project BETA teachers attended training workshc^ and conference given by the district office. The 
project director abo disseminated informal letters to inform teadters about materials, aclivilies^ curricula, etc. 

Prc^ net elective. 



• Sixty percent of program staff members will enroll in at least one univeraty course each semester. 
The staff director report«l that apprradmately half the nzff numbers enrolled in a oniveraty course. 
Prq^ dkl net ncet elijcctfve. 



Currfculum Pevekw)mcnt 

• By June 1991, a manual (draft) containing teaming activities and methods used for E.S.L. and 
%>anish reading will be prepared parik^Ung teachers and ^aff. 

Grade-appropriate manuals bad been developed and were used by parifcipaiing teachers. With the help 
of the curriculum guides, Project BETA suff and faculi}' achieved untformiiy throughout all project classrwms at 
each site. 

Project Bwt objective. 



Parental Involvement 

• By June 1991, 60 percent of the parents of Urgci students will have participated in program-related 
activities. 

• By June 1991, 60 percent of the parents of target siudenU will have particijMted in E.S.L. and 
Spanish reading «nivities. 

The project conducted ten parent meetings, at which E.S.L., Spanish reading, and arts activities were 
offered. The project director reported that 60 percent of the parents of target students participated in these 
activities. 

Project net objectives. 



Attendance 

Project BETA did not propose any attendance objectives. The project students' attendance rate was 93.4 

percent. 
Dropout 

No dropout objective was proposed, and no data were submitted by project. 



SlUDENTS WITH SPECIAL ACADEMIC NEEDS 

Project BETA staff followed the procedures estabUsbed CS.D. 7 for referring students to special 
education, m accordance with New York Cily Public Schools regulations. C «»ssroom teachers who felt that a 
student required special education services referred himlier to the guidance x>unsek)r. Staff consulted parents 
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before advising the bilingual SchooKBased Support Team (S.B.S.T.). 

Nine ^udents (2.S percent of participants) were retained in grade. 



MAINSTREAMING 

None of this year's particq>ant5 were mainstreanied. 
Academic Achievement of Former Project Students in Mafeayeam 
V The project did not provide data on former pn^ect partic^iants. 

CASE HiyrpRY 

Maria M. at P.S. 5 was a model student in the Project BETA program. She 2K>t only learned the steps 
and movements of Spanish dancing quk^, but ^e was at:^ to ctpt^ the emotion, Ayle, and dsaracterstks of a 
true flamenco gypsy dancer. Her musical talents, ranging from racahzatk>n to denerity on the xylq>hone, were 
outstanding. Maria also learned to use duferent art media-crajronsv India ink, pencil, and watai»k>rs-and made 
a papier madi^ statue of an Aztec Indian for BETA'S P.S. 5 World's Fair. 

Maria's artistic inteiests ateo served to enridi her academkaDy. Her reading and comprehension 
improved, and her writing and ^peaking abilities were laore (Teative. Her creative writing (stories and poeti^) 
brought her an award in sports IBustrated magazine. 
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APPENDIX A 



DATA CX>LLECnON AND ANA1.YS1S 

Student Data Form 

This one-page form is filled out by staff for each partidpatiiig and mamstreamed student. OREA gathers 
data from this form on backgrounds, demographics, academfc outcomes, attendance, referrals, and exii from the 
program. 

Pru|ect Director's Questionnaire 

The Pitjject Director's Questionnaire inchides questions on staff quahfications, program implementation, 
periods of instruction, and in^ructiona] materials and i^niques. 

Project pirector's Interview 

The interview gathers informatk>n on program and student or staff charaderistics not supplied by the 
Project Director's Questionnaire. The interview also allows project staff to offer qualitalr.-e data or ampUfy 
responds to the Questionnaire. 

C'iu'vvide Test Scores 

OREA retrieves scores centrally from the Language Assessment Baiieiy (LAB) and other cii>'widc tests. 
For evaluation purposes, these test scores are reported in Normal Curve Equivalents (N.C.E.s). N CE.s arc 
normalized sUndard scores with a mean of 50 and a standard deviation (5.d.) of 21.06, They constitute an equal- 
interval scale in which the distance is the same between any two adjacent scores. A gain of 5 N.C.E.s is the same 
whether it is at the lower or the higher end of the scale. N.C.E.s can be used in arithmetic computations to 
ihdicate group progress. (Percentfle scales, although more familiar to many, are unsuitable for such computations 
since they arc not equal-interval.) 

Likert-Tvpe Surveys 

Likert-iype surveys, in which re^ndents mark their opinions on a scale from one to five, arc used in a 
variety of ways. They examine student attitudes (i.e., toward school and career, native language use, and naiKc 
and mainstream cultures). They also assess staff and parent attitude and reactions to workshops and other 
actK'ities. 

Gap Reduction Evaluation Design 

OREA uses a gap redaction des^n for measuring changes in standardfeed tests. Since no appropriate 
non-project comparison group is available in New York City, where aU students of Umiied English proficiency 
(LEP) are enthled to receive supplementaiy services, OREA compares the progress of partidpaling students with 
that of the group on whfch the test was normed. It is assumed that the norm group would show a zero gain in 
the absence of instruction, and gains made by project students could be attributed to project services. 
(Sec "Citywide Test Scores" above.) 

To test whether pre/posttest gains are greater than could be expected by chance alone, OREA uses a 
t-iest. To determine whether a difference between two proporlbns (e.g., program and mainstream attendance 
'rates) is greater than could be expected by chance, OREA uses a z-iest. The level of signricance is set at .05 for 
all tests. 
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APPENDIX B 



Instructional Materials 



Isstmctboal materials used include pn^am-ftevetoped, teKber-made, and amunerciaUy produced 
materials. AD partidpalmg bilingual classes received resources in the form of multimedia library centers. These 
centers contained books, ^mstrips, audk) tapes, records, and games in Mder to: (a) reinlbroe skSk in E.S. 
Spansb leacfing; (b) prt^fkte independent and eiyc^ble activiti^ and (c) encourage researdi a&d creative 
writing. Program staff nsed BLTA-devek^ manuals as trabiins materals for paitkqMting teadiers as weD as 
providing them with oonsumal^ art aippUes and materials for hiqjkmentiag activities in the curricttlum. 

Some of the basic in struct iooal texts used included the following: 



Titk 

Addkon Weslev E.S.L.. A-P 
Open the liribt 

ffffl^^^ B,^X4vF.L. I^^upy Pook 

Mfl Maravnias. Soan^ Reading Scries 
Camoanitas de Pro. Spanish Big Books 



Author PnMfcation 
Mkhael Walker Addi^^ Wesley, 1^ 
Coreen Carmthers Addison Wesley, 1982 



_ National Teitbooks, 1988 

Maurice Sendak Harper & Row. 1963 



S paniel Reading Series 



Macmillan Pub&hing Co.^ 1987 
Leaorum Putting Co., I'^SB 
Houghton Mifflin. 1989 
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